Mirror Worlds for Robots: Fricial, Artifriction, and Resonial in Low-Dimensional Interaction Projections

Physical Intelligence Research • Garlileo Lab

In traditional robotics and world model research, the default assumption is that robots need a complete 3D understanding of the environment. Cameras, LiDAR, and depth sensors are used to generate detailed 3D scene graphs to support tasks like grasping, navigation, and interaction. However, the complexity of real-world environments creates enormous computational and data burdens: the combinatorial possibilities of object geometry, materials, lighting, and environmental dynamics lead to exponentially large state spaces.

Mirror Worlds: Compressing 3D into Behavior-Relevant 2D

Instead of reconstructing full 3D scenes, we propose providing robots with a mirror-like 2D world — a compressed, task-relevant representation that preserves only the information critical for decision-making. Key features include:

This mirrors human vision: the eyes capture a 2D projection, and the brain infers depth, shape, and dynamics. Similarly, a robot can rely on Fricial projections — representations of friction and interaction constraints — to replace full 3D reconstruction.

Integrating Fricial, Artifriction, and Resonial

In this mirror world:

The combination ensures that the robot not only perceives the physics but also models how agents and objects behave and interact over time.

Technical Implementation

  1. Visual Encoder
    Transform camera input into a feature map that emphasizes task-relevant regions and interaction cues.

  2. Fricial Projection Layer
    Map features into a 2D Fricial space capturing contact points, friction coefficients, and support surfaces for each object.

  3. Artifriction Module
    Use learned models to estimate likely outcomes of interactions within the Fricial space, predicting grip success, slip probabilities, and dynamic behavior.

  4. Resonial Coordination Layer
    Maintain phase alignment and temporal consistency between multiple agents or objects, ensuring coherent multi-agent dynamics in the mirror world.

  5. Low-Dimensional Policy Execution
    Reinforcement learning or planning occurs in the mirror world, guiding real-world actions efficiently.

  6. Feedback Correction
    Sensor feedback (force/torque, tactile, or visual) updates Fricial and Artifriction representations, closing the loop.

Advantages

Conclusion

Mirror worlds challenge the conventional approach of full 3D reconstruction. By integrating Fricial, Artifriction, and Resonial, robots operate in a compressed, interaction-focused projection space. This framework emphasizes not the shape of objects, but how they behave and interact, providing a scalable and interpretable pathway for advanced world models. Future systems may combine these layers to support complex multi-agent coordination, efficient planning, and real-world adaptability, bridging the gap between perception and action in digital and physical environments.